Papers with Role Integration
Role Prompting Guided Domain Adaptation with General Capability Preserve for Large Language Models (2024.findings-naacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) suffer catastrophic forgetting when tailored to specific domains . authors present a novel approach to manage multi-domain LLM adaptation . |
| Approach: | They propose a strategy to manage multi-domain LLM adaptation using self-distillation and role integration. |
| Outcome: | The proposed model alleviates catastrophic forgetting and inter-domain confusion while maintaining robust general capabilities. |